METHOD AND SYSTEM FOR PROJECTING A DENTAL RESTORATION FOR A PATIENT

专利摘要:
2d image layout. it is a method of projecting a dental restoration (1140) to a patient, in which the method comprises: - providing one or more 2d images (1101), where at least one 2d image (1101) comprises at least least one facial feature (1103); - providing a virtual 3d model (1102) of at least part of the patient's oral cavity; - arrange at least one of one or more 2d images (1101) in relation to the virtual 3d model (1102) in a virtual 3d space, such that the 2d image (1101) and the virtual 3d model (1102) are aligned when viewed from a viewing point, through which the virtual 3d model (1102) and the 2d image (1101) are both viewed in 3d space; and - model a restoration (1140) in the virtual 3d model (1102), in which the restoration is designed to fit the facial feature (1103) of at least one 2d image (1101).
公开号:BR112012033392B1
申请号:R112012033392-5
申请日:2011-06-29
公开日:2020-12-15
发明作者:Tais Clausen；Rune Fisker；Nikolaj Deichmann；Henrik Ojelund
申请人:3Shape A/S；
IPC主号:

专利说明:

Field of the Invention
[0001] This invention relates, in general, to a method of visualizing and modeling a set of teeth for a patient. More particularly, the invention relates to the provision of a virtual 3D model of the patient's set of teeth. The method is at least partially implemented by computer. Background of the Invention
[0002] The visualization and modeling or design of teeth are known in the field of dental restorations.
[0003] When a patient needs a dental restoration, such as crowns, bridges, supports or implants, the dentist will prepare the teeth, for example, a damaged tooth is ground to make a preparation in which a crown is glued on it. An alternative treatment is to insert implants, such as titanium screws, into the patient's jaw and mount crowns or bridges over the implants. After tooth preparation or implant insertion, the dentist can make an impression of the upper jaw, lower jaw and a bite record or a single impression on a double-sided tray, also known as triple trays. The impressions are sent to the dental technicians who manufacture the restorations, for example, the bridge. The first step in manufacturing the restoration is to traditionally fuse the upper and lower dental models of the upper and lower jaw impressions, respectively. The models are usually made of plaster and often lined up on a dental articulator using the bite register to stimulate the actual bite and chewing movement. The dental technician builds the dental restoration inside the articulator to ensure a good visual appearance and bite functionality.
[0004] CAD technology for the manufacture of such a restaurant expands rapidly, improving quality, reducing costs and facilitating the possibility of manufacturing in attractive materials, otherwise not available. The first step in the CAD manufacturing process is to create a three-dimensional model of the patient's teeth. This is traditionally done by 3D scanning of one or both dental plaster models. The three-dimensional replicas of the teeth are imported into a CAD program, in which the entire dental restoration, such as a bridge substructure, is designed. The 3D design of the final restoration is then manufactured, for example, using a grinding machine, 3D printer, rapid prototype fabrication or other fabrication equipment. The precise requirements for dental restorations are very high, otherwise, dental restoration would not be visually interesting, it would not fit over the teeth, it could cause pain or infections.
[0005] The document WO10031404A refers to tools in a system for the design of customized three-dimensional models of dental restorations for subsequent manufacture, in which dental restorations are like implant supports, copings, crowns, waxes and bridge frames. In addition, the invention relates to a computer-readable means for deploying such a system to a computer.
[0006] The visualization and modeling of teeth for an established patient are also known in the field of orthodontics.
[0007] US2006127836A discloses orthodontic systems and methods for determining the movement of a tooth model from a first position to a second position by identifying one or more common features in the tooth model; detect the position of common features in the tooth model in the first position; detect the position of common features in the tooth model in the second position; and determine a difference between the position of each common resource in the first and second positions.
[0008] In this way, orthodontics refers to the movement of teeth, so that the desired position of a tooth or teeth is determined, and based on the present position of that tooth or teeth, the movement from this position to the desired position It is determined. Thus, within orthodontics, the desired or resulting position of a tooth or teeth is known before planning the movement steps.
[0009] It remains a problem to provide an improved method and system to provide aesthetic beauty and / or physiologically adequate results of tooth modeling, both within the field of restorations, implants, orthodontics, etc. summary
[00010] A method of projecting a dental restoration to a patient is revealed, in which the method comprises: - providing one or more 2D images, in which at least one 2D image comprises at least one facial feature; - provide a virtual 3D model of at least part of the patient's oral cavity; - arrange at least one among one or more 2D images in relation to the virtual 3D model in a virtual 3D space, so that the 2D image and the virtual 3D model are aligned when viewed from a viewing point, through which the virtual 3D model and the 2D image are visualized in 3D space; and - model a restoration in the virtual 3D model, in which the restoration is designed to fit the facial feature of at least one 2D image.
[00011] The terms design and model are used interchangeably in this document to describe what is done to make the restoration fit for the patient. The user, for example, a dental technician, can digitally design or model a restoration on the virtual 3D model.
[00012] It is an advantage that the 3D CAD modeling of the virtual 3D model is based on a 2D digital image, since the 2D image determines or indicates what type of modeling is suitable, in which the appropriate expression can understand physiologically adequate or aesthetically suitable or attractive. In this way, the 2D image is used to perform a correct modeling of the 3D model, since the 2D image works as a reference point or rule for what type of modeling is possible or how the modeling can be within the limits provided by 2D image. In this way, the modeling of the virtual 3D model is decided and performed based on one or more 2D images, that is, how the modeling of the virtual 3D model is based on the visualization of the 2D image.
[00013] The patient's oral cavity may comprise at least the set of teeth present in the patient, such as prepared teeth or unprepared teeth, if he has no teeth, and may be part of the gums. If the patient has no teeth, then the oral cavity can comprise the patient's gums.
[00014] The 2D image (s) can typically be a digital image, and the term 2D digital images can be used interchangeably with the term 2D image in the specification.
[00015] It is an advantage that there can be one or more 2D images. If there are more 2D images, a 2D image can be used to align with the 3D virtual mode, and another 2D image can be used to design the restoration. However, even if there are more 2D images, the same 2D image can be used for alignment and projection of the restoration. The other 2D images can then only be used for viewing and presentation etc. If there is only one 2D image, that 2D image is used both for alignment with the virtual 3D model and for projection of the restoration.
[00016] In this way, the 2D image that comprises facial features can be denoted the first 2D image, and the 2D image that is used for alignment in relation to the virtual 3D model can be denoted the second 2D image. If there is only one 2D image, then the first 2D image and the second 2D image are the same 2D image. If there are more 2D images, then the first 2D image and the second 2D image can be the same 2D image, but they can also be two different 2D images.
[00017] The restoration is configured to be manufactured, as by rapid manufacture, as by grinding, printing etc. The restoration can be faceted, as by adding porcelain to the surface of the restoration after machine fabrication. When the restoration is finished, it can be inserted into the patient's mouth.
[00018] It is an advantage that 2D digital images and the virtual 3D model are aligned when viewed from a viewing point, since, through this, the user or system operator who performs the method, can view the image in 2D and 3D model from a viewing point where they are aligned, as long as this allows and facilitates the modeling of the 3D model based on the 2D image. The 2D image and 3D model are aligned when viewed from a viewing point means that at least some structures of the 2D image and the 3D model coincide when viewed from a viewing point. Thus, the 2D image and 3D model may not be aligned when viewed from any viewing point, so there may be only one viewing point from which the 2D image and 3D model are aligned.
[00019] Additionally, it is an advantage that the 2D image and the 3D model are arranged and remain as separate data representations that are not joined or merged into one representation. By keeping data representations as separate representations, time is saved and data processing and capacity time is reduced. In this way, the 2D image is not superimposed or covered over the virtual 3D model to create a representation with all the data included. The prior art documents describe that data from, for example, a color image is added to the 3D model, so that the color content of the image is transferred to the 3D model, through which the result is a representation, that is that is, the 3D model that includes color. Creating such models requires more time and exhaustive data processing.
[00020] Thus, it is an advantage that the present method can be performed faster than the methods of the prior art.
[00021] The method is for use when shaping teeth, but it can, of course, also be advantageously used by students within the dental field when learning how to shape teeth and what to take into account when shaping teeth.
[00022] Teeth shaping is defined as comprising shaping one or more dental restorations, shaping one or more implants, shaping orthodontic movement of one or more teeth, shaping one or more teeth in a denture, for example, a fixed or removable denture to provide a visually pleasing appearance to the set of teeth etc.
[00023] In this way, the modeling can comprise the modeling of restorations, orthodontic planning and / or treatment, implant modeling, denture modeling, etc. When CAD modeling comprises, for example, restorations, virtually modeled restorations, such as crowns and bridges, can be manufactured using CAM, and fabricated restorations can then be finally inserted into the patient's teeth by a dentist.
[00024] The arrangement, placement or positioning of 2D digital images in the virtual 3D model is performed digitally on a computer and shown on a user interface as a screen, such that the user or operator obtains a visual representation of the 2D image and the 3D model together in the same field of view, through which the operator can perform the modeling based on the simultaneous viewing of the 2D image and the 3D model, instead of being based on a combined representation or separate views of the 2D image and / or the 3D model.
[00025] To facilitate the placement of the 2D image and the 3D model in relation to each other, edge detection can be performed, through which the contour of the teeth in the 2D image and / or in the 3D model is automatically derived. Edge detection can be performed using a software algorithm. Edges are points where there is a boundary or border between image regions, and edges can thus be defined as sets of points in the image that can have a strong gradient magnitude. The contour of the teeth can then be detected by detecting the edge between portions of the image showing the teeth and gum.
[00026] One or more 2D images can be provided in the method, and 2D images can, for example, show the patient's face from different directions, show different parts of the patient's face, as facial features in the form of lips and eyes or nose, for example, to determine facial lines, show different examples of new teeth, where the teeth of the 3D model can be shaped to look similar, show the patient's teeth before preparing teeth for restorations and after prepare teeth, etc.
[00027] In some embodiments, the restoration is designed on at least one tooth prepared in the virtual 3D model. In some modalities, the 2D image and the 3D model are aligned based on one or more unprepared teeth.
[00028] In some modalities, the tooth prepared in the virtual 3D model is a physical preparation of the patient's teeth.
[00029] In some modalities, the tooth prepared in the virtual 3D model is a virtual preparation modeled in the virtual 3D model.
[00030] In some modalities, the virtual 3D model comprises at least one prepared tooth.
[00031] In some embodiments, the virtual 3D model does not comprise prepared teeth, and in which the virtual 3D model is of the patient's oral cavity before at least one tooth is prepared.
[00032] In some embodiments, the method comprises providing two virtual 3D models, in which the first virtual 3D model comprises at least one prepared tooth and the second virtual 3D model does not comprise prepared teeth, and in which the first and the second 3D models virtual are aligned.
[00033] In some modalities, the 2D image and the second virtual 3D model that do not include prepared teeth are aligned.
[00034] In some embodiments, the 2D image and the first virtual 3D model comprising at least one prepared tooth are aligned based on the alignment between the first and the second virtual 3D model and based on the alignment between the 2D image and the second 3D model.
[00035] During the alignment of the 2D image and the 3D model, the 2D image can be of the patient's unprepared teeth, since it can be easier to align the 2D image and the 3D model, when the teeth in the image in 2D are not prepared. During restoration modeling, for example, new teeth from the 3D model, the 2D image can then be of the patient's prepared teeth, since, for example, restorations are usually modeled after having prepared the teeth by cutting part of the teeth. teeth, such as crowns etc. can be attached to the prepared part of the teeth.
[00036] The 2D image of the prepared teeth can be aligned to the 2D image of the unprepared teeth before the restoration in the 3D model is projected / modeled based on the 2D image with the prepared teeth, since it may be easier to align the 2D images of prepared and unprepared teeth, for example, with the use of lips and other features of the face or teeth, than aligning the 2D image of prepared teeth with the 3D model, since here it can be difficult to find matching resources in those.
[00037] However, the method can also be used before the dentist prepares any teeth or teeth, for example, to present and show the patient what this set of teeth might look like if a restoration is done on one or more of the teeth.
[00038] The method can be used to design a diagnostic wax used to view the results of a restoration before treatment is performed.
[00039] During the projection of a diagnostic wax-up, a virtual margin line and a virtual preparation can be made for the projection of the diagnostic wax-up, although no real preparation is done.
[00040] The method can be used to design a provisional, which the patient can use after the dentist has prepared a tooth and before the final restoration is manufactured and placed on the prepared tooth.
[00041] The restoration can be designed, for example, automatically, by selecting a tooth in the 2D image, for example, the tooth in the position where the restoration is to be placed or on a different aesthetic tooth. In the 2D image, the selected tooth is only seen from a viewing point, such that only the front side, the width and height of the tooth can be seen in the 2D image. In this way, the posterior side of the tooth cannot be seen. A standard model tooth can be selected from a library, and this model tooth can be shaped like the selected tooth in the 2D image. The model or restoration tooth can only be formed as the selected tooth on the surfaces that are seen in the 2D image. The rest of the model tooth or restoration can be shaped according to some standard for a tooth at the respective location in a mouth. For example, the posterior side or the distal surface of a central tooth can be typically flat, while the distal surface of a canine can typically be triangular in shape, and the distal surface of a molar can typically look like the mesial surface of the tooth. . Either the distal surface of the neighboring teeth or the corresponding tooth on the other side of the midline in the mouth can be used to conform the surfaces of the restoration that cannot be derived from the 2D image. The restoration can be designed in the virtual 3D model, and the part of the restoration that is in contact with, for example, the preparation can be automatically designed to resemble the shape of the restoration.
[00042] The restoration can be a crown, a bridge, a support, an implant, a denture, such as a fixed or removable denture, a complete denture or partial denture, a diagnostic waxing, a provisional etc.
[00043] The projection of a restoration can comprise the projection of at least part of a preparation, projection of at least a part of the gingiva surrounding the restoration in the patient's mouth, etc.
[00044] It is an advantage that the restoration is designed to fit or be compatible with the facial feature of at least one 2D image, as this will provide a restoration that looks natural in relation to the patient's face and / or that will provide a restoration that is aesthetic, as well as symmetrical. The rules of dental techniques for the projection of teeth, mathematical or algorithmic rules and / or rules for aesthetics can be programmed in the software or used in the software or method for the projection of the restoration to fit the facial features and, based on these rules , the restoration can be designed, for example, partially automatically. The dental technician or dentist can use their experience and knowledge of rules and dental aesthetics to design and determine when the restoration fits the facial feature in the patient's image or in a standard face image or template.
[00045] The projection of the restoration to fit the facial features of the 2D image may be based on purely objective rules for the restoration project. However, the projection of the restoration to fit the facial features of the 2D image may alternatively and / or additionally be based on more subjective opinions and choices by the dental technician or dentist.
[00046] In some modalities, facial features are present in an image of the patient and / or in a generic image of an individual.
[00047] In some modalities, the facial feature is one or two lips, one or more teeth and / or the shape and / or size of the face.
[00048] In some modalities, facial features comprise one or more imaginary lines of a face adapted to be detected in the 2D image, such as the midline, the horizontal line and / or the bipupilar line.
[00049] If the 2D image is an image of at least part of the patient's face, then the facial features used for the projection of the restoration can be the patient's lips, the smile line of the patient's mouth, the lines of symmetry on the patient's face, the midline of the patient's face, the horizontal line of the patient's face, the patient's anterior teeth, etc. In this way, the restoration can be designed to fit the restoration to the patient's lips, adjusting the restoration to the smile line of the patient's mouth, adjusting the restoration to the patient's anterior teeth, etc.
[00050] If the 2D image is an image, like a drawing, of a generic template face, then the facial features used to design the restoration can be symmetrical lines of the template face, shapes and sizes of the teeth on the face of the feedback etc.
[00051] During the projection of the restoration to fit the facial features, the restoration can be designed so that there is a certain distance from the edge of the upper lip to the incisal edge of the anterior teeth, for example, the central teeth, when the patient smiles a natural smile; and / or so that a certain percentage or number of exchanges is visible when the patient smiles. Additionally, during the projection of the restoration to fit the facial features, the restoration can be designed considering the shape of the patient's face, the patient's gender, the patient's phenotypic characteristics, that is, if the patient is Asian, African, cau - caseid, etc. For example, Asians typically have smaller teeth, men typically have larger teeth than women, oval teeth typically fit into an oval face shape, etc.
[00052] Additionally, if the patient has a small dental arch or jaw, then the distance between the canines will typically be shorter and the anterior teeth should then typically be narrower than the teeth in a patient with a large arch. and a greater distance between the canines.
[00053] In some modalities, the restoration is a crown, a bridge, a support, an implant, a denture, a diagnostic and / or a provisional waxing.
[00054] In some modalities, the projection of the restoration is performed to automatically adjust to the facial features of at least one digital 2D image.
[00055] In some modalities, the restoration is designed by selecting a tooth in the 2D image and modeling the restoration to have the same shape as the selected tooth.
[00056] In some modalities, the virtual 3D model is generated by scanning a physical model of the patient's teeth, by scanning an impression of the patient's teeth, and / or by performing a direct scan of the patient's teeth. If the patient has no teeth, then the gums, a model or impression of the gums can be scanned to create a 3D model of the oral cavity.
[00057] In 3D scanning, the object is analyzed to collect data in its format. The collected data can then be used to build digital three-dimensional models. In 3D scanning, normally, a cloud of geometric sample points on the surface of the object in question is created. These points can then be used to extrapolate the shape of the object in question.
[00058] In some embodiments, one or more 2D digital images comprise a specific patient image of at least part of the patient's face.
[00059] An advantage of this modality is that the modeling can be based on an image of the patient, so that the modeling is carried out in relation to the facial features that make up the patient's look or appearance, or in relation to a few, few or a single patient-specific visual facial feature, such as the lips.
[00060] In some embodiments, one or more 2D digital images comprise a generic image of at least part of a human face.
[00061] An advantage of this modality is that the modeling can be based on a generic image, through which it is not the specific facial features of the patient that determine the modeling, but, instead, it is a general image, for example, the facial features can be some visually pleasing teeth for someone else, or the facial feature can be a design of some ideal teeth etc ...
[00062] In some modalities, one or more 2D digital images are retrieved from a library that includes numerous images of teeth.
[00063] An advantage of this modality is that the 2D image, as a generic image, can be selected from a library that contains, for example, several images of teeth, such that the patient, for example, can choose his new set of teeth. desired teeth of the library. The library can be a library called the smile guide that comprises images of teeth and / or mouths that are shown smiling, given that visually pleasing teeth may be more important while smiling, as this happens when most teeth is shown.
[00064] The images of teeth in the library can be pictures of teeth, they can be drawings of teeth, etc. and so the facial features are, then, the teeth. In some embodiments, the 2D image comprises a cross to provide visual symmetry that is adapted to be used to design the restoration.
[00065] In some modalities, one or more 2D digital images is a template to support the projection of the patient's teeth.
[00066] An advantage of this modality is that when the 2D image is a template, then, the operator can arrange and model teeth using this template to obtain a visually pleasing modeling result. In this way, the template can comprise facial features in the form of guide lines, rough blocks for the placement of teeth, etc.
[00067] Thus, facial features, such as imaginary lines, on a patient's face, such as the midline, the horizontal line, the bipupilar line, etc. they can be used to determine what the restored teeth should look like, that is, resources, such as lines, can be used to project the restoration (s).
[00068] In some modalities, the template comprises a facial feature in the form of the midline of a face. In some modalities, the template comprises a facial feature in the form of the horizontal line that passes along the anterior teeth.
[00069] In some modalities, the template comprises a facial feature in the form of the occlusal plane of a face.
[00070] An advantage of the modalities in which the template comprises some facial features, such as the midline of the face, the horizontal line, an occlusal plane etc., is that these features can help in the layout of the 2D image and the 3D model one in relation to the other and in modeling the restoration of the 3D model.
[00071] In some modalities, the template comprises a facial feature in the form of boxes adapted to fit the central, the lateral and the cusps.
[00072] An advantage of this modality is that it allows the operator to easily model a restoration of the different anterior teeth to be visually pleasing. For example, the sides can advantageously be 2/3 the width of the central ones, and the cusps or canines can advantageously be slightly narrower than the central ones.
[00073] In some modalities, the template comprises a facial feature in the form of one or more long geometric axes of anterior teeth.
[00074] An advantage of this modality is that the long geometric axes can be used to indicate the alignment of the long geometric axis of teeth and / or the vertical direction of teeth for support in modeling the restoration.
[00075] In some modalities, the facial feature in the form of the long geometric axes of at least the upper anterior teeth converge towards the incisal edge or the bite edge.
[00076] An advantage of this modality is that it is visually pleasing when the long geometric axes of at least the upper anterior teeth converge towards the incisal.
[00077] In some modalities, the template comprises a facial feature in the form of a contour of teeth.
[00078] In some embodiments, the contour comprises the shape of one or more teeth seen from the front.
[00079] An advantage of the modalities in relation to the tooth contour is that the use of the visually pleasing contour of some teeth can be a simple and easy way to model the restoration teeth of the 3D model.
[00080] In some modalities, the template comprises a facial feature in the form of a curve.
[00081] An advantage of this modality is that through a curve, distances and angles can be measured or visualized. For example, a distance can be measured from the center of the curve, and in one example, the operator can measure x mm from a given point on the curve, and at that distance something specific can be arranged, such as a distal point on a side . In addition, the curve can be a symmetry curve to ensure that the modeled restoration teeth are symmetrical.
[00082] In some modalities, the facial feature in the form of a curve comprises an arch that accompanies the upper and / or lower anterior teeth seen from the front or from above.
[00083] In some modalities, the facial feature in the form of a curve comprises a smile line adapted to accompany the lower lip in a natural smile and the incisal edges of the upper teeth.
[00084] In some modalities, the template comprises a facial feature in the form of one or more curves to indicate the position of the gingival tissue.
[00085] An advantage of these modalities in relation to the curves of the teeth and / or the mouth and lips is that the use of some type of curve (s) can be a simple and easy way to model the restoration teeth of the 3D model .
[00086] In some modalities, one or more 2D digital images show at least several frontal teeth.
[00087] It is an advantage to have a facial feature in the form of frontal teeth, since frontal teeth can be good starting points for the projection of other restorative teeth.
[00088] In some modalities, the one or more 2D digital images are a photograph that shows at least one facial feature in the shape of the patient's lips and teeth seen from above.
[00089] An advantage of this modality is that when the 2D image shows the patient's lips and existing teeth, then the modeling of the restoration teeth can be performed in such a way that it adapts to the patient's lips and to the unchanged teeth, providing a visually pleasing modeling result.
[00090] In some modalities, the method also includes cutting virtually at least part of the teeth out of one or more 2D digital images, if the 2D image comprises teeth, so that at least the lips remain visible in the images 2D digital displays.
[00091] An advantage of this modality is that when the lips and none or only a few teeth are visible in the 2D image, then it is easy to view the modeled restoration teeth of the virtual 3D model with the patient's lips and determine whether the restoration is a good modeling result. The cutting of teeth outside the 2D image can be carried out real or digitally, such that the information in the 2D image in relation to the teeth is removed, deleted, made invisible, etc.
[00092] If there is an empty space between the teeth, such as between the upper and lower teeth in the 2D image, then that free space can also be removed from the 2D image, such that everything inside the lip edge is removed and the 3D model can be seen inside the edge of the lips. The lips themselves should preferably not be cut, as the lips should preferably be seen during the projection of the tooth restoration, so that the restoration is designed to fit the patient's lips or the standard lips, template, model of a 2D image of template.
[00093] Virtual cutting of the teeth in the 2D image can be performed by segmenting the lips and teeth in the 2D image. The segmentation can be performed by the dental technician who manually extracts with a digital drawing tool along the edge or lines of the lips and / or teeth and, through this, performs the segmentation. Segmentation can also be performed automatically using known image processing algorithms. Segmentation can also be performed by analyzing the color difference in the 2D image, and using the criteria that teeth are usually white / yellow or gray and that the lips are usually red / pink / flesh. Segmentation can also be performed by defining one or more models of lips or models of teeth and then digital search of the 2D image for features that are compatible with models of lips and / or models of teeth.
[00094] The edge of the lips can be marked using image processing tools, digital drawing tools, such as hand tools, semi-automatic tools, fully automatic tools, standard image processing tools, a combination of different drawing tools etc. .
[00095] One of the 2D images can be a 2D image of the patient in which the teeth can be seen behind the lips, for example, in which it is seen as much as possible of the teeth, for example, in an image in which the patient I smile, like your natural smile.
[00096] It can be an advantage that the teeth present in the patient can be seen in the 2D image, since this can be used during the projection of the restoration. In particular, the appearance and appearance of the patient's present lips and teeth in relation to each other when the patient smiles, can be used during the projection of the restoration.
[00097] Another one of the 2D images can be a 2D image of the patient in which the teeth cannot be seen, for example, in which the lips are closed.
[00098] In some modalities, the virtual 3D model is visible behind the lips.
[00099] An advantage of this modality is that when the 3D model can be seen behind the lips, then, the modeling of the restoration teeth can be performed during the visualization of the lips to determine if the modeling is satisfactory. In some modalities, the method involves cutting the part of the 2D image that is inside the edge of the lips.
[000100] In some modalities, the edge of the lips is marked on the 2D image.
[000101] In some modalities, the edge of the lips is manually marked using digital drawing tools.
[000102] In some modalities, the lip border is marked by means of a digital spline curve.
[000103] In some modalities, the edge of the lips is marked by means of semi-automatic drawing tools.
[000104] When a part of the 2D image and a part of the virtual 3D model must be viewed / seen / present at the same time, then, for example, the pixels referring to the lips in the 2D image can be selected for viewing and the pixels referring to the teeth in the virtual 3D model can be selected for viewing, and the 2D image and the virtual 3D model can be combined in this way.
[000105] As an alternative to cutting teeth in the 2D image, the teeth in the 2D image can be made transparent, so that the teeth in the 3D model can be seen in place of the teeth in the 2D image. Making the teeth in the 2D image transparent is a performance similar to that of cutting, for example, by selecting a few pixels to be viewed and selecting other pixels that should not be viewed.
[000106] In some modalities, one or more 2D digital images show the patient's face, so that facial features in the form of facial lines, such as the midline and the bipupilar line, are detectable. An advantage of this modality is that facial lines determine the geometry of the patient's face, and to obtain a visually pleasing modeling result, the teeth must conform to this general geometry. In some embodiments, the one or more 2D digital images are an X-ray image of the patient's teeth.
[000107] An advantage of this modality is that during the use or application of an X-ray image of the patient's teeth, the entire teeth with roots under the gum can be seen and, thus, broken or weak roots or teeth can be detected. For example, implants that exert force on teeth and roots can be designed to be arranged in such a way as to exert force on non-broken or weak teeth and roots, rather than weak and broken teeth and roots.
[000108] In some modalities, the method also includes providing a 3D computerized chromatography scan of the patient's face to facilitate the alignment of one or more 2D images and the 3D model and / or to model the virtual 3D model.
[000109] In some embodiments, one or more 2D digital images are a still image from a video recording.
[000110] In some modalities, one or more 2D digital images are derived from a 3D face scan.
[000111] When the 3D face scan is seen on the screen, it can be seen from a certain perspective, thereby producing a certain 2D projection of the 3D scan. In this way, the 2D image can be derived from the 2D projection of the 3D face scan.
[000112] In some modalities, the method also comprises providing a 3D face scan of the patient to facilitate the alignment of one or more 2D images and the 3D model and / or to model the virtual 3D model. 3D face scanning can be provided by aligning and / or combining multiple face sub-scans, such as sub-scans from different angles.
[000113] Additionally, at least some of the sub-sweeps can be at least partially overlapped.
[000114] A face scan can also comprise texture and at least part of the subtextures of at least part of the sub-sweeps can be color adjusted and / or interpolated color, such as by weaving the texture, to provide the texture of the face scan in 3D or 3D model.
[000115] During the performance of a patient's face scan, at least part of the patient's hair can be dusted with a reflective powder.
[000116] Additionally, the silhouettes of multiple sub-sweeps can be extruded and subsequently crossed to provide a visual hull approach.
[000117] Texture, such as color, of the 2D image or a face scan can be mapped over the virtual 3D model and / or mapped over the restoration.
[000118] If the restoration looks like the original tooth being restored, then it can be an advantage to use the texture, for example, color of the 2D image. But if the restoration does not look like the original tooth or if there is no original tooth, then the texture, for example, color of the 2D image may not be mapped for the restoration.
[000119] The texture mapping, for example, color of the 2D image on the virtual 3D model and / or the restoration can be an advantage to design the restoration, since it can, for example, help in determining the color of the restoration and / or other texture features of the restoration.
[000120] The teeth and tissue, such as gums, in the 3D model can be at least partially segmented. Segmentation can be provided using a computer-implemented algorithm, such as a shorter trajectory algorithm applied to a 3D matrix that represents the curvature of the tooth surface.
[000121] The segmentation can alternatively / additionally be at least partially based on the color information in the 3D model.
[000122] In some embodiments, a patient's face scan provides a measurement of the distance the upper and / or lower lip moves when the patient smiles, and the distance is adapted to be used to measure the ideal length of at least some of the teeth.
[000123] An advantage of this modality is that at least the length of the frontal teeth is important for the visual appearance of the teeth.
[000124] In some modalities, the method also includes providing at least part of one or more 2D digital images to be at least partially transparent, so that the virtual 3D model is visual through 2D digital images.
[000125] Transparency can mean total transparency, for example, meaning that something is completely invisible, partial transparency or translucency, for example, meaning that the graphics are partially transparent, for example, like colored glass. Partial transparency can be simulated at some level by mixing colors.
[000126] When all or a part of the 2D image and / or all or a part of the virtual 3D model must be transparent, then, for example, some of, like every second, pixels in the 2D image can be selected for viewing and some of, like every other second, pixels in the virtual 3D model can be selected for viewing, and the 2D image and the virtual 3D model can be combined in such a way, such that one or both of these become transparent, for example, interchangeably transparent.
[000127] Fading can be achieved in a similar way to transparency, for example, by selecting certain pixels for viewing and other pixels for not viewing.
[000128] In some modalities, one or more 2D digital images are adapted to be slightly faded in and out of sight.
[000129] An advantage of this modality is that during the slight fading of the 2D image in and out of view, this causes the visualization of 2D digital images to change from fully visible to partially visible and, then, perhaps invisible and vice- versa. Through this, the 2D image can be viewed as the user wishes. Fading in and out can be gradual. In some modalities, the method also comprises providing at least part of the virtual 3D model to be at least partially transparent, such that at least one of one or more 2D digital images is visual through the virtual 3D model.
[000130] In some modalities, the method comprises the unmasking of the 3D model slightly in and out of view.
[000131] In some modalities, the 2D image and the 3D model are adapted to be alternately faded in and out of view. In some modalities, the 2D image is adapted to be faded in view, when the virtual 3D model is faded out of view, and vice versa.
[000132] In some modalities, the 2D image and the virtual 3D model are adapted to be faded in and out of sight independently of each other.
[000133] In some modalities, the virtual 3D model comprises the patient's set of teeth. In some modalities, the 2D image and the virtual 3D model are aligned by scaling, translating and / or rotating the 2D image and / or the 3D model in relation to each other.
[000134] In some modalities, the 2D image display is fixed, and the virtual 3D model is scaled and / or translated and / or rotated in relation to the 2D image.
[000135] In some modalities, the method comprises selecting a viewing point of the virtual 3D model that provides an optimal adjustment to 2D digital images.
[000136] In some modalities, the dental articulation of the upper and lower teeth in the virtual 3D model is adapted to be adjusted to resemble the articulation of the upper and lower teeth in the 2D image.
[000137] In some modalities, the method also includes scaling to one or more 2D digital images and the virtual 3D model to show at least part of the teeth in the same size.
[000138] An advantage of this modality is that the 2D image and the 3D model must be shown on the same scale in order to perform the modeling more efficiently. Scaling can be an automatic modification of the size, for example, from the virtual 3D model to the size of 2D digital images or vice versa. Alternatively, you can scale the 2D image and the 3D model to resize them to a predetermined scale.
[000139] In some modalities, the method also includes the alignment of one or more 2D digital images and the virtual 3D model.
[000140] An advantage of this modality is that when the 2D image and the 3D model are aligned, then, the restoration modeling can be performed easier and with a better result. Alignment can be defined as the adjustment of an object in relation to another object, such that the structures of the objects coincide. In this way, common or similar structures of the 2D image and the 3D model can be aligned.
[000141] In some embodiments, the silhouette of the bite edge of at least the upper anterior teeth on one or more 2D images and the virtual 3D model is used to align the 2D image and the virtual 3D model. An advantage of this modality is that, in many cases, the bite edge of the upper anterior teeth is seen in the 2D image and in the 3D model and, therefore, this bite edge can be an advantageous physical alignment point.
[000142] In some modalities, the method also includes projecting the plane of one or more 2D digital images to the virtual 3D model.
[000143] An advantage of this modality is that during the projection of the 2D image plane to the 3D model or to a 3D model plane, the 3D model and the 2D image can be viewed in the same plane, which can be a advantage when modeling restorative teeth. Viewing the 3D model and the 2D image in the same plane can otherwise be complex.
[000144] In some modalities, the method also includes changing the perspective view of one or more 2D digital images and / or the virtual 3D model to obtain the same perspective view.
[000145] An advantage of this modality is that the restoration modeling can be facilitated when the 2D image and the 3D model can be seen in the same perspective view.
[000146] For the alignment of the 2D image and the 3D model, 2D projection of the 3D model can be performed. The projection can be a perspective projection, a parallel projection like an orthographic projection, etc. Corresponding points can be selected in the 2D image and in the 3D model, a projection of the 3D model over 2D space can be made, and the distance between the corresponding points in the 3D model projected in 2D and in the 2D image can be minimized to that the location of the corresponding points are coincident or almost coincident. The location can be minimized through iteration, as in the nearest interactive point (ICP), a method for aligning 3D models.
[000147] In some modalities, the method also includes distorting the perspective view of one or more 2D images to visually align the 2D image and the virtual 3D model. Discord can be used if the 2D image of the patient's mouth is, for example, taken at an angle from above, from below and / or from one side, but it is desired that the 2D image of the patient's mouth be seen from the front, as a frontal image may be easier to use when projecting a restoration onto the patient's teeth.
[000148] Warping or warping can be used to connect image distortion. Warping or disorientation can comprise point-to-point mapping. This can be mathematically based on any function of the (part of) the plan to the plan.
[000149] Thus, an advantage of this modality is that when the unveiling or correction of the perspective view of the 2D image, then the view is digitally manipulated and, through this, points in the perspective view of the 2D image can be mapped to the points on the 3D model or its plane. After unfastening or correcting the perspective of the 2D image, the 3D model can be realigned, such that the 2D image and the 3D model are aligned again.
[000150] In this way, the disorientation can be carried out by projecting the 2D image or the teeth of the 2D image onto the virtual 3D model. Since the 3D model can only understand the patient's teeth, a face model, such as the patient's own face or a generic face model, can be used to align the 2D image and the virtual 3D model. A new perspective view of the virtual 3D model can now be selected and a new 2D image can be derived from it. This new 2D image can be a corrected, undistorted version or view of the original distorted 2D image.
[000151] In some modalities, the scheduling, alignment, projection on a plane, disorientation in perspective and change of perspective are defined as virtual actions for disposition or alignment.
[000152] In some modalities, one or more of the virtual actions for disposal comprise rotations and translations to the left / right and back / front of one or more 2D digital images and / or the virtual 3D model. An advantage of this modality is that when providing rotations, translations etc., then different movements of the 2D image and / or the 3D model can be performed to facilitate the scaling, alignment, change of perspective and, finally, to facilitate the modeling of the teeth.
[000153] In some modalities, the method also comprises the steps of: - detecting anatomical points in the teeth, in which the anatomical points are present and detectable in one or more 2D digital images and in the virtual 3D model, and - performing the virtual actions for disposition based on these corresponding anatomical points.
[000154] An advantage of this modality is that the use of corresponding anatomical points, common or mutual in the 2D image and the 3D model can be an easy way to perform the alignment of the 2D image and the 3D model, where after modeling restoration teeth to be performed.
[000155] For correct alignment of the 2D image and the virtual 3D model, the number of corresponding points in the 2D image and the 3D model can be similar to the number of degrees (DOF) of freedom to move the 2D image and the 3D model in relation to each other. The number of degrees of freedom can, for example, be seven; thus, seven corresponding points may be needed to correctly align the 2D image and the virtual 3D model. To calculate the number of degrees of freedom, a camera model can be estimated. The camera model can comprise numerous internal parameters and numerous external parameters. The internal parameters can be magnitude, also known as enlargement or scaling, and projection in perspective or distortion. External parameters can be the placement and orientation of the camera in relation to the object, for example, the set of teeth.
[000156] The degrees of freedom can be translations in the three directions in space and rotations around the three geometric axes in space.
[000157] To reduce the number of degrees of freedom and thus, for example, to reduce the required number of corresponding points in the 2D image and in the 3D model, it can be assumed that all teeth rest on the same plane. Therefore, the internal parameters must not comprise the projection in perspective or distortion, but only the magnitude. In this way, a parallel projection can be assumed and, for example, it can be assumed alternatively and / or additionally that the 2D image of a patient's face is captured exactly from the front.
[000158] If a patient's teeth are photographed from a distance of about 1 meter, which can typically be the case when photographing teeth for this method, then the hypothesis about parallel projection may be acceptable.
[000159] For some cases, it may be a reasonable hypothesis that all teeth rest on the same plane, however, in other cases, this hypothesis may not be correct, and it may be difficult or even impossible to align the 2D image and the model Virtual 3D using this hypothesis.
[000160] In practice, alignment can be accomplished by fixing the 2D image in position and then moving the virtual 3D model in relation to the fixed 2D image using, for example, a 3D motion controller, a device 3D navigation device, a 6DOF device (six degrees of freedom) or a 3D mouse, such as a spaceball.
[000161] If the virtual 3D model can be reduced to a 2D model, then the 2D image and the 2D model can be aligned using three points, since the alignment can then comprise magnitude or scaling, translation in one direction and rotation on a geometric axis.
[000162] The difficult part of aligning a 2D image and a virtual 3D model can be to perform the rotation, since translation and scaling or magnitude can be more easily performed.
[000163] Perspective projection can be activated in the software program in which the restoration is projected, and when perspective projection is activated, the 2D image and / or the virtual 3D model can understand more depth. The perspective can be a parameter that can be adjusted, activated, fixed, etc. in the software program to perform the method.
[000164] In some modalities, at least one corresponding anatomical point is selected to perform the virtual actions for disposal.
[000165] An advantage of this modality is that a common or mutual point in the 2D image and in the 3D model may be sufficient for the layout of the 2D image and the 3D model in relation to each other. However, in other cases, the 2D image and the 3D model must be aligned using more points, such as two, three or four points. In general, three points may be appropriate. Four points can be used to make an even better arrangement or for use in more difficult cases.
[000166] In some modalities, the method also comprises the steps of: - providing a virtual measurement bar, and - carrying out the virtual actions to dispose of one or more 2D digital images and / or the virtual 3D model through adjustment to the virtual measuring bar.
[000167] An advantage of this modality is that it can be easier and faster to use a virtual measurement bar to perform the virtual actions for disposition as scaling, in which the sizes of the 2D image and the 3D model are adjusted to correspond with each other.
[000168] In some modalities, the method also includes that a user performs the virtual actions for the provision of one or more 2D digital images and / or the 3D virtual model by means of visual measurement.
[000169] An advantage of this modality is that only by using simple visual measurement, the operator can quickly and reliably arrange the 2D image and the 3D model in relation to each other or perform a raw starting point for a more detailed adjustment. In some modalities, the anatomical points are distal and / or mesial points superior and / or inferior over a number of specific anterior teeth.
[000170] An advantage of this modality is that the anatomical point on the distal and / or mesial parts of the upper and / or lower anterior teeth is normally easy to detect in the 2D image and in the 3D model.
[000171] In some modalities, the modeling of the 3D model is performed automatically based on one or more 2D digital images.
[000172] An advantage of this modality is that the user does not need to perform any manual modeling of the 3D model on the screen, when the modeling can be performed in a fully automatic manner. However, typically, if automatic modeling occurs, then the user can check that the modeling is satisfactory, and can make minor corrections in the modeling. In some modalities, the method also comprises automatically selecting one or more 2D digital images that provide an optimal fit or compatibility with the virtual 3D model.
[000173] An advantage of this modality is that the 2D image with a great, good or better compatibility or fit to the 3D model can be automatically selected and, through this, an excellent restoration modeling result can be obtained and, additionally, the time used to model the restoration can be reduced, as no individual needs to waste time looking for a large number of 2D images. The 2D image can be selected from a library of 2D digital images, or from any source comprising numerous images of teeth and smiles. The library can understand templates, photos, drawings etc. with facial features.
[000174] In some modalities, the optimal fit or compatibility is determined based on specific parameters to provide an aesthetic and visually pleasing appearance. An advantage of this modality is that the optimal, best or just good fit or compatibility can be determined based on different parameters, such as the present size of the patient's teeth, the curves of the patient's present set of teeth, etc. New teeth that are too big may not suit a person who used to have very small teeth or a person who has thin lips. Similarly, a set of new teeth with a strong makeup may not suit a person who used to have a set of teeth with a soft makeup or a person who has thick lips, etc. So, based on the facial features present as structures, features, formats etc. of the patient's teeth, new teeth that will look natural and will suit the patient can be determined from, for example, a library of photo templates, drawings etc.
[000175] In some modalities, the alignment of at least one 2D image and the 3D model is performed automatically. In some modalities, the 3D model and two or more of the 2D images are aligned in relation to each other, when there is more than one 2D image.
[000176] In some modalities, the 3D model and each of the 2D images are aligned in relation to each other.
[000177] It is an advantage that the 3D model is specifically aligned to each of the 2D images, so that if there is displacement between the different 2D images, the correct alignment of the 3D model in relation to the selected 2D image can be displayed automatically in the user interface. In some modes, the different alignments of the 3D model in relation to the two or more 2D images are stored in a data store.
[000178] In some modalities, the alignment of the 3D model and a specific 2D image is retrieved from the data store, when the specific 2D image is selected for viewing. In some embodiments, two or more of the 2D images are 2D images of at least part of the patient's face seen from different directions.
[000179] In some modalities, the method also includes sectioning at least two or more of the teeth in the 3D model and / or in one or more 2D images.
[000180] In some modalities, the 2D image and the 3D model are adapted to be arranged and / or viewed from one or more views in perspectives.
[000181] Perspective views can be from a front, rear, side, top, bottom and any combination of these views. A visual or non-visual point, for example, a center point, a line, for example, a center line or a region, for example, a central region in the 3D model and / or in the 2D image, can determine the reference point for the views in perspective. In some embodiments, the method comprises determining an angle of one or more of the views in perspective.
[000182] The angle can be the angle in relation to a central point of the 2D image and / or the 3D model. The angle can be an angle in relation to a horizontal plane and / or a vertical plane etc. that virtually intercepts the teeth in the 2D image and / or in the 3D model.
[000183] In some embodiments, the method comprises predefining an angle of one or more of the views in perspective. In some modalities, at least one of one or more 2D images is from a video stream of 2D images.
[000184] In some modalities, the 2D images of the video stream are from different perspective views. In some modalities, the 3D model is configured to be aligned in relation to one or more 2D images in the video stream.
[000185] In some modalities, the alignment of the 3D model and one or more 2D images for one or more perspective views is performed through interpolation and / or extrapolation from other perspective views.
[000186] It is an advantage that already determined perspective views can be used to align other perspective views. Perspective views can be present or arranged on a virtual or curved path and / or on a virtual viewing point sphere. In this way, if two perspective views have already been determined, a third perspective view located between the two perspective views can be determined by extrapolation or interpolation and the 3D model and 2D image can be aligned in relation to this or with based on that. Perspective views or angles can be provided by an angle shift, view directions etc., and the displacements can be smooth and continuous or in different steps.
[000187] In some modalities, the method comprises approximating at least one among one or more 2D images and the 3D model in / out of view. In some modalities, the 2D image and the virtual 3D model are adapted to be approximated inside / outside simultaneously.
[000188] It is an advantage that the 2D image and the 3D model can be approximated inside / outside simultaneously and / or united and / or together and / or concurrently and / or synchronously. In this way, the increase or decrease in the size of the 2D image and the 3D model can be similar during the approach, the 2D image and the 3D model can follow each other during the approach, and the central point or central region of the approach can match the 2D image and the 3D model.
[000189] In some modalities, the approach inside / outside is configured to be carried out from one or more views in perspective. In some modalities, the inside / outside approach is configured to be performed from one or more predefined angles.
[000190] In some embodiments, the predefined angles determine the views in perspective.
[000191] In some modalities, the method comprises providing the predefined angles in different stages. In some embodiments, the method comprises providing the predefined angles in a continuous sequence.
[000192] In some modalities, the 2D image and the 3D model are snapped together or locked together in their correct alignment.
[000193] It is an advantage that if, for example, the 2D image is viewed from a side perspective, then the 2D image is automatically snapped or locked at the correct angle in relation to the 3D model.
[000194] When the alignment of the 2D image and the virtual 3D model is found, that alignment is saved, and if the 2D image and the 3D model are then moved again relative to each other, the saved alignment can be used to snap or lock the 2D and virtual 3D image together again with the correct alignment. In some modalities, the snap fit of the 2D image and the 3D model is performed automatically.
[000195] In some modalities, each of the one or more 2D images is configured to be snapped together with the 3D model in its correct alignment. In some embodiments, the 2D image and the 3D model are aligned based on one or more unprepared teeth, if unprepared teeth are present in the 3D model. In some modalities, the 2D image and the 3D model are aligned based on the teeth in the upper jaw.
[000196] It is an advantage to align based on the upper teeth because these are typically the most visible teeth in a 2D image, in particular, the front teeth in the upper jaw are usually more visible and the alignment can therefore be improved if these teeth are used for alignment.
[000197] Alternatively and / or additionally, the teeth in the lower jaw of the 3D model can also be moved, for example, in a way downstream to obtain proper alignment.
[000198] In some modalities, the angle at which the 3D model and the 2D image are seen as standard is determined by the perspective view of the 2D image. The angle can also be denoted a view, viewing point, perspective view, etc.
[000199] In some modalities, the angle of the 3D model and the 2D image is configured to and adapt to the perspective view of the 2D image.
[000200] The angle can also be denoted view, viewing point, perspective view etc.
[000201] In some modalities, the view of the 3D model is configured to adapt to the perspective view of a second 2D image, if that second 2D image is replacing a first 2D image.
[000202] It is an advantage that the view can change automatically when a second 2D image is selected for viewing, alignment, etc.
[000203] In some modalities, the method also includes generating a 3D image by combining at least three of the 2D images.
[000204] In some modalities, the method also includes rendering the 3D model. It is an advantage to perform the rendering of the teeth in the 3D model, as a photorealistic rendering, since through this, the 3D model is made to look more realistic and pleasant. The 3D model can be, for example, yellow or gray by default, so by rendering the teeth in the 3D model to be, for example, whiter, the 3D model teeth look better and more realistic.
[000205] Rendering can be performed using well-known methods performed using well-known computer programs.
[000206] In some modalities, the method also includes providing texture resources in the 3D model.
[000207] It is an advantage to provide texture features in the 3D model to make the teeth of the 3D model look more realistic and real. The tooth texture resources can be obtained from a 2D image of the patient's existing teeth, the texture resources can be of a standard template, can be generated specifically for the specific 3D model based on the size, shape etc of the teeth. teeth. In addition, other parameters such as shading, geometry, viewing point, lighting and hatching information can be provided for the 3D model to make the teeth of the 3D model look more realistic and possibly appear more aesthetic. In some modalities, the texture of the 2D image is mapped in the virtual 3D model and / or in the restoration.
[000208] In some modalities, rendering is a photorealistic rendering. In general, it is an advantage of the method and the modalities that these allow dental laboratories (labs) to superimpose a real face of the patient and smile images in the projection process and use this directly to produce personalized and aesthetic restorations in a more efficient. Laboratories can show dentist patients exactly how a new restoration will transform their smiles and get feedback. The smile visualization is highly achievable due to the fact that it can be solidly supported by the manufactureable 3D model and not just 2D image manipulations.
[000209] Custom designs with patient-specific 2D image coatings can be achieved by importing 2D images of the patient's lips, teeth and smile to design restorations that exactly match the patient's personal appearance. Image manipulation tools can be applied to mask teeth, and alignment tools can be used to put lips and design new teeth together as a perfect custom design guide.
[000210] High aesthetics with generic 2D image coatings can be achieved by using 2D image libraries that help to achieve high aesthetics, even without photographs of the patient's current smile. Through the method, it is possible to select from a variety of smile guides and design templates to recreate complete smile compositions to apply with the restoration project.
[000211] The visualization of the before and after can be obtained, for example, by continuous switching between situation views through the gradual fading in and out, through which technicians, dentists and patients have the ability to easily detect even the smallest changes and smile details for excellent comparisons.
[000212] The present invention relates to different aspects including the method described above and below, and corresponding methods, devices, systems, uses and / or product medium, each producing one or more of the benefits and advantages described in connection with a first aspect mentioned, and each having one or more modalities corresponding to the modalities described in connection with the first aspect mentioned and / or disclosed in the appended claims. In particular, a system for designing a dental restoration for a patient is disclosed herein, wherein the system comprises: - means for providing one or more 2D images, wherein at least one 2D image comprises at least one facial feature ; - means to provide a virtual 3D model of at least part of the patient's oral cavity; - means to arrange at least one among one or more 2D images in relation to the virtual 3D model in a virtual 3D space, such that the 2D image and the virtual 3D model are aligned when viewed from a viewing point, through the which the virtual 3D model and the 2D image are both visualized in 3D space; and - means for modeling a restoration in the virtual 3D model, in which the restoration is designed to fit the facial feature of at least one 2D image.
[000213] Additionally, the present invention relates to a computer program product which comprises means of program coding to cause a data processing system to perform the above method, when said means of programming coding executed in the system of data processing, and a computer program product according to the preceding claim, which comprises a computer-readable medium which has the program encoding means stored therein.
[000214] According to another aspect, a computer-implemented method of visualizing, projecting and modeling a set of teeth for a patient is revealed, in which the method comprises the steps of: - providing one or more digital 2D images; - provide a virtual 3D model of at least part of the patient's oral cavity; - arrange at least one of one or more 2D digital images in relation to the virtual 3D model in a 3D space, such that the at least one 2D digital image and the virtual 3D model are aligned when viewed from a viewing point, through which the virtual 3D model and at least one 2D digital image are visualized in 3D space; and - model the virtual 3D model based on at least one of one or more 2D digital images. BRIEF DESCRIPTION OF THE DRAWINGS
[000215] The above and / or additional objectives, resources and advantages of the present invention will be elucidated below by the detailed illustrative and non-limiting description of the modalities of the present invention, with reference to the attached drawings, in which:
[000216] Figure 1 shows an example of a flow chart of a method of visualization and modeling of a set of teeth for a patient.
[000217] Figure 2 shows examples of viewing a 2D image and a 3D model together.
[000218] Figure 3 shows an example of viewing and arranging a 2D image and a 3D model.
[000219] Figure 4 shows examples of the layout of the 3D model and the 2D image in relation to each other.
[000220] Figure 5 shows examples of 2D images as barbarites.
[000221] Figure 6 shows examples of how to perform virtual actions to arrange the 2D image and the 3D model.
[000222] Figure 7 shows an example of viewing and arranging a 2D image and a 3D model.
[000223] Figure 8 shows an example of how a 3D model can be placed on a 2D image, or how a 2D image can be placed on a 3D model.
[000224] Figure 9 shows an example of a before and after view.
[000225] Figure 10 shows an example of rendering a 3D model of teeth arranged in relation to a 2D image.
[000226] Figure 11 shows an example of aligning a 2D image and a virtual 3D model in relation to each other, cutting the mouth and teeth of the 2D image to see the virtual 3D model in place of the teeth, and projection of a restoration in the virtual 3D model based on the 2D image. DETAILED DESCRIPTION
[000227] In the description that follows, reference is made to the attached figures, which show by way of illustration how the invention can be practiced.
[000228] Figure 1 shows an example of a flow chart of a method of designing a dental restoration for a patient.
[000229] In step 101, one or more 2D digital images are provided, in which at least one 2D image comprises at least one facial feature. The 2D image can be a photograph of at least part of the patient's face, a template of teeth, a drawing of teeth, a photo or image of a set of aesthetic teeth, etc. 2D digital images can be displayed on a user interface, such as a computer screen.
[000230] In step 102, a virtual 3D model of the patient's oral cavity comprising the patient's set of teeth, if any teeth are provided. The 3D model of the patient's teeth set can be generated by scanning a physical model of the patient's teeth, by scanning an impression of the patient's teeth and / or by performing a direct scan of the patient's teeth. If the patient does not have teeth, then the gums, a model or impression of the gums can be scanned to create a 3D model of the oral cavity. The virtual 3D model can be shown on a user interface, such as a computer screen.
[000231] In step 103, 2D digital images are arranged or positioned in relation to the virtual 3D model to view the virtual 3D model in relation to 2D digital images. The arrangement or positioning is a digital and virtual arrangement, carried out through software, such that the 2D image and the 3D model can be viewed together. 2D digital images and the virtual 3D model are aligned when viewed from a viewing point, through which the virtual 3D model and 2D digital images are viewed in 3D space. The software program user can use digital tools to manually align the 2D image and the virtual 3D model, or the 2D image and the virtual 3D model can be automatically aligned using digital processing means, or the alignment of the 2D image and the virtual 3D model can be a combination of manual alignment performed by the user and automatic alignment. The 2D image used for alignment with virtual 3D can be the same 2D image that comprises facial features or it can be a different 2D image.
[000232] In step 104, a restoration of the virtual 3D model is modeled, in which the restoration is designed to fit the facial feature of at least one 2D image. Thus, the part of the virtual 3D model of the patient's set of teeth that comprises the restoration is digitally modeled or virtually or projected based on the visualization of the 2D image layout that comprises the facial feature. In this way, the 3D model of the patient's existing teeth is modeled using CAD, and the modeling can comprise restorations, orthodontic planning and / or treatment, prosthesis production, removable dentures, etc. Virtually modeled restorations, such as crowns and bridges, can be manufactured using CAM, and fabricated restorations can then be inserted into the patient's teeth by a dentist.
[000233] Figure 2 shows examples of viewing a 2D image and a 3D model together.
[000234] Figure 2a) shows a screen capture in which a 2D image 201 and a 3D model 202 are viewed simultaneously. The 2D image 201 is a photograph of a part of an individual's face that shows facial features in the form of a mouth with lips 203 and teeth 204 behind lips 203. The photograph can be of the patient himself or someone else. Using a photograph of the patient can be advantageous if the patient's teeth are broken and the patient then wishes to have their teeth restored so that they look as they did before the damage. The use of a photograph of another person may be an option if the patient wishes to have his teeth restored, exchanged for a set of new teeth and / or treated by orthodontists so that they look and / or are arranged in a different way than used to be in the present.
[000235] The 3D model 202 of the patient's teeth comprises 208 gingiva and 207 teeth.
[000236] Figure 2 b) shows an example in which the 2D image 201 is an X-ray image of the patient's teeth. The X-ray image shows facial features in the shape of the patient's 204 teeth. Since the X-ray image shows the teeth approximately in lines, that is, not in curves as in real life, at least part of the plane of the X-ray image can be shifted with respect to perspective, warped, projected and / or flexed to be arranged in relation to the 3D 202 model with 207 teeth.
[000237] Figure 3 shows an example of viewing and arranging a 2D image and a 3D model.
[000238] Figure 3 a) shows the screen capture in which a 2D 301 image and a 3D 302 model of teeth are viewed simultaneously. The 2D image 301 is a photograph or drawing showing facial features in the form of a pair of lips 303 and a tooth outline 304 behind the lips. A vertical line 305 and a horizontal line 306 are drawn through the 2D image 301 and can also be used as guidelines for modeling a restoration.
[000239] Figure 3 b) shows the screen capture in which the 2D image 301 is arranged and aligned in relation to the 3D model 302. The teeth 307 of the 3D model 302 can be seen through and between the lips 303 and the outline of teeth 304 of the 2D image 301. During the placement and alignment of the 2D image in relation to the 3D model, the modeling of a restoration in the 3D model is facilitated. The vertical line 305 and the horizontal line 306 are also seen in Figure 3 b).
[000240] Figure 3 c) shows a sketch of a 2D image 301 and a 3D model 302 seen in a perspective side view that illustrates the alignment from a viewing point. The 2D image 301 and the 3D model are in this figure with the attempt to be drawn in a perspective side view to show that if the 2D image and the 3D model are viewed from that viewing point, then they are not aligned . In the other figures, for example, in Figure 3b), the 2D image and the 3D model are viewed from a frontal viewing point in which they are aligned. As seen, there is a distance between the 2D image and the 3D model to indicate that the 2D image and the 3D model are separate representations and not a representation containing data from two representations. The distance can be any distance, such as shorter or longer than that illustrated in this proportion.
[000241] The arrow denoted X illustrates the front view in which the 2D image and the 3D model are aligned, as seen, for example, in Figure 3b).
[000242] The arrow denoted Y illustrates a bottom view in which the 2D image and the 3D model are viewed from below, and as they can be derived from the figure, the 2D image and the 3D model are not aligned when viewed from the point Y display
[000243] The end of an arrow, circle with a cross, denoted Z, illustrates a side view, and, as explained above, in relation to the side view in perspective, the 2D image and the 3D model are not aligned when viewed from that viewing point. Figure 4 shows examples of arrangement of the 3D model and the 2D image in relation to each other.
[000244] Figure 4 a), b) and c) shows examples of different dispositions of the 3D model 402 in relation to the 2D image 401. The teeth 407 of the 3D model 402 seem to have been moved in relation to the lips 403 of the 2D image 401 in Figure 4a), b) and c). When the layout of the 3D model 402 has become appropriate in relation to the 2D image 401, the actual modeling of the 407 teeth of the model 3D 402 can be performed.
[000245] Figure 5 shows examples of 2D images as templates that include facial features. Figure 5 a) shows an example of digital images in 2D 501, which are a frame of reference for placing the patient's teeth and / or modeling a restoration. The frame of reference comprises a template 509 for the anterior or upper front teeth. The jig 509 comprises facial features in the form of a midline of a face 505 and a horizontal line 506 that crosses the incisal edge of the anterior teeth.
[000246] Template 509 comprises facial features in the form of boxes adapted to fit central 510, lateral 511 and cusps 512, also known as canines. The sides 511 can be ideally 2/3 the width of the panels 510, and the cusps 512 can be ideally slightly narrower than the panels 510. Figure 5b) shows an example in which the 2D image 501 is a template 509 comprising facial features in the form of long geometric axes 513 of central 510, lateral 511 and cusps 512. Long geometric axes 513 converge in the direction of the incisal edge indicated by a horizontal line 506. Figure 5c) shows an example in which the image in 2D 501 is a template 509 showing facial features in the form of a contour 514 of front or front teeth seen from the front.
[000247] Figure 5d) shows an example in which the 2D image 501 comprises a template 509 comprising facial features in the form of a curve 515 of a smile line adapted to follow the lower lip in a natural smile and as incisal edges of the upper anterior teeth 510, 511, 512, as seen from the front.
[000248] Figure 5e) shows an example in which the 2D image 501 comprises a template comprising facial features in the form of three curves 516 to indicate the position of the gingival tissue.
[000249] Figure 5f) shows an example in which the 2D image 501 comprises or is a template 509 comprising a curve in the form of an arcade 517 that follows the upper teeth as noted above. Figure 5g) shows an example in which the 2D image 501 comprises or is a template 509 comprising a curve 518 that follows the upper anterior teeth as noted above.
[000250] The arcade 517 and curve 518 are also denoted facial features.
[000251] Figure 6 shows examples of how to perform alignment or virtual actions to arrange the 2D image and the 3D model in relation to each other.
[000252] Virtual actions for disposition may include the following: - scale the 2D digital images and the virtual 3D model in order to show at least part of the teeth in the same size in both; - align 2D digital images and the virtual 3D model; - project the virtual 3D model to a plane of 2D digital images; - change the perspective view of 2D digital images and / or the virtual 3D model in order to obtain the same perspective view for both when viewing the positioning; - distort the perspective view of the virtual 3D model to visually align the 2D image and the virtual 3D model.
[000253] The virtual actions for disposition can be performed by means of rotations and translations to the left and right and from the front to the back of the 2D digital images and / or the virtual 3D model.
[000254] In an example (not shown), the silhouette of the bite edge of at least the upper anterior teeth in the 2D image and in the virtual 3D model is used to align the 2D image and the virtual 3D model. Figure 6a) shows an example in which alignment or a virtual action for arrangement as alignment is performed using the corresponding anatomical points 619 detected in the teeth in the 2D digital images 601 and in the teeth in the 3D virtual model 602. The anatomical points 619 shown in Figure 6a) are in the upper anterior teeth. An anatomical point is on the incisal border on the distal side of the left lateral tooth, where left is left as seen in the figure, but right for the patient. Another anatomical point is on the incisal border between the left and right central teeth. The third anatomical point is in the gingiva between the right lateral tooth and the right cusp tooth, where the right is right as seen in the figure, but left for the patient.
[000255] When the corresponding anatomical points 619 are detected and, for example, marked as in the figure in the 2D image 601 and in the 3D model 602, the 2D image 601 and the 3D model 602 can be arranged in relation to each other and aligned each other by providing that the corresponding anatomical points 619 in the 2D image 610 and in the 3D model 602 cover, overlap, match or adjust. When corresponding anatomical points 619 are selected on the screen, the software can automatically arrange the 2D image 601 and the 3D model 602 so that the 619 points overlap.
[000256] Figure 6b) shows an example in which a virtual action for disposition as scheduling is performed with the use of a virtual measuring bar 620. The virtual measuring bar 620 is seen in the 2D image 601 and in the 3D model 602 In the 2D image 601, the measuring bar 620 has a length that corresponds to the length along the two upper center 610 and the two lateral 611. However, in the 3D model, the measuring bar 620 has a length that corresponds to the two upper central 610, the two lateral 611 and the two cusps 612. Therefore, in order to have corresponding sizes of the 2D image 601 and the 3D model 602, the 3D model should be enlarged or enlarged to fit the size of the 2D image.
[000257] Alternatively and / or additionally, the user can perform virtual actions for the disposition of digital images in 2D and / or the virtual 3D model by means of eye measurement.
[000258] Figure 7 shows an example of viewing and arranging a 2D image and a 3D model.
[000259] Figure 7 shows a screen capture of a user interface in which a 2D 701 image and a 3D 702 model of teeth are viewed simultaneously. The 2D image 701 is a photograph of a part of the patient's face comprising facial features in the form of patient 703's lips and patient 704's existing upper teeth behind the lips. In place of the lower teeth in the 2D image, the 3D model comprising the lower teeth 707 is arranged.
[000260] The 3D model 702 is arranged and aligned in relation to the 2D image 701.
[000261] The restoration in the 3D model can be modeled to adjust the facial features in the 2D image such as the patient's lips, upper anterior teeth, etc.
[000262] Figure 8 shows an example of how a 3D model can be arranged in a 2D image, or how a 2D image can be placed on top of a 3D model.
[000263] Figure 8 shows a screen capture of a user interface in which a 2D image 801 is observed. The 2D image 801 is a photograph of a part of a patient's face comprising patient's lips 803 and patient's existing upper teeth 804 behind the lips.
[000264] If a 3D model with teeth should be placed in place of the lower teeth, the area of the lower teeth in the 3D image can be marked and hidden or deleted using a non-transparent area 830. The marked area 830 can be marked at the draw a line 831 along the edge of the upper teeth and lower lips. Line 831 can be marked automatically using automatic contouring and / or color detection of the 2D image. Alternatively and / or additionally, the operator can draw line 831 or, otherwise, mark area 830.
[000265] The same can be applied if a greater or lesser number, for example, all teeth in the 2D image has been replaced by the teeth of a 3D model.
[000266] Figure 9 shows an example of an anterior and posterior view.
[000267] An anterior and posterior visualization can be obtained through the continuous exchange between visualizations of the situation through the gradual discharge, through which technicians, dentists and patients can easily detect even the smallest changes and details of the smile for ideal comparisons . Figure 9 shows an example in which part of a 2D 901 image and part of a 3D 902 model of teeth are observed simultaneously. The 2D image 901 is a photograph of a part of a patient's face that comprises facial features in the form of patient 903's lips and patient 904's existing teeth behind the lips. In place of the lower and upper teeth on the left side of the patient's mouth (right side for the patient), the 3D model comprising teeth 907 is observed.
[000268] The 3D model 902 is arranged and aligned with the 2D image 901. The existing teeth 904 in the 2D image 901 correspond to the situation before the restoration of one or more teeth. The 3D model 902 with restored teeth 907 corresponds to a possible situation after restoration of the teeth. Since the observation can be switched between anterior and posterior visualization, for example, through gradual fading, the suggested changes can obviously be observed and evaluated. Figure 10 shows an example of rendering a 3D model of teeth arranged in relation to a 2D image.
[000269] Figure 10 shows an example in which a 2D image 1001 and a 3D model 1002 of teeth are observed simultaneously. The 2D image 1001 is a photograph of a part of a patient's face that comprises the patient's lips 1003. In place of the teeth in the 2D image, a 3D model comprising restored and modeled restored teeth 1007 is arranged. The restored 1007 teeth in the 3D model were rendered as a photorealistic rendering.
[000270] Figure 11 shows an example of aligning a 2D image and a virtual 3D model in relation to each other, cutting the mouth and teeth of the 2D image to observe the virtual 3D model in place of the teeth, and projecting a restoration in the virtual 3D model based on the 2D image.
[000271] Figure 11 shows several steps that can be taken to design a restoration, but it must be understood that all these steps should be taken to design a restoration. In some cases, the alignment of the 2D image and the virtual 3D model may be performed differently than shown in figures 11, and in some cases, the mouth and teeth are not cut from the 2D image as shown in figures 11 .
[000272] Figure 11 a) shows a virtual 3D model 1102 of a set of patient's teeth. A first model of the 1140 restoration in the form of a bridge comprising three teeth is designed. The restoration is white while the original teeth in the 3D models are brown / gray in the figure.
[000273] Figure 11 b) shows 3D model 1102 with restoration 1140. In the lower right corner, a menu 1141 is shown that allows the user to select a 2D image to cover 3D model 1102.
[000274] Figure 11 c) shows a 2D image 1101 of the patient's lower face showing the mouth including lips 1103 and existing teeth 1104. Menu 1102 is also seen in the lower right corner.
[000275] Figure 11 d) shows the 2D image 1101 with lips 1103 and teeth 105, and the virtual 3D model 1102 with restoration 1140. The 2D image 1101 was made partially transparent so that the 2D image and the virtual 3D model can be observed. A scale in the 1141 menu in the lower right corner can be changed to adjust the transparency of the 2D image and / or the 3D model.
[000276] Figure 11 e) shows the 2D image 1101 and the virtual 3D model, in which the 2D image was made partially transparent, so that the 2D image and the virtual 3D model can be observed. The 2D image and the virtual 3D model were aligned which can be seen on that incisal edge of the three anterior teeth 1142, 1143 and 1144 which corresponds to the 2D image and the virtual 3D model.
[000277] Additionally, it can be seen that the first model of the 1140 restoration was designed so that the new teeth in the 1140 restoration are slightly smaller than the original teeth in the 2D image.
[000278] The patient may have required restoration 1140 because the original teeth were broken, damaged, dead, caused problems with occlusion, problems with the gums, etc. Figure 11 f) shows the 2D image 1101 and the virtual 3D model 1102, in which the transparency of the 2D image is slightly different compared to the transparency in Figure 11 e). In Figure 11 f), the 2D image is less transparent than in Figure 11 e). Transparency can be adjusted using the scale in menu 1141.
[000279] Figures 11 g), 11 h) and 11 i) show an example of virtual cutting of the teeth of the 2D image.
[000280] Figure 11 g) shows the 2D image 1101 of the patient's lower face in which lips 1103 and teeth 1104 can be seen. Line 1131 along lips 1103 is marked and, through this, the entire area 1130 on the lips can be marked.
[000281] Figure 11 h) shows the 2D image 1101 in which area 1130 on line 1131 along lips 1103 has been emptied, that is, replaced by an empty space, a blank area, etc. In this way, teeth 1104 in area 1130 are removed from observation, excluded, disregarded, etc. The 1130 area was made transparent so that the virtual 3D model arranged through the 2D image can be seen in the 1130 area.
[000282] Figure 11 i) shows area 1130 which is the part of the 2D image 1101 on line 1131 along the lips. In this way, teeth 1104 are seen in that cut part of the 2D image.
[000283] Figure 11 j) shows the 2D image 1101 with the cut area 1130 along the line 1131 of the lips 1103, and the virtual 3D model 1102 is now visible in the cut area 1130 of the 2D image. The 1140 restoration of the 3D 1102 model is observed, and it can be seen that the 1140 restoration has not yet been designed, since there is a greater gap between the upper central teeth, in which the left central tooth (as observed by the observer, but the central tooth on the right) is part of the 1140 restoration.
[000284] Figure 11 k) shows that the 1140 restoration was finally designed, since the 1140 restoration was designed as the two upper central teeth. In this way, the 1140 restoration was designed based and designed to correspond and adjust to the facial features observed in the 2D image, such as the lips 1103. In this case, in which the restoration consists of three of the upper anterior teeth, the restoration also it is partially designed to be symmetrical to the corresponding teeth on the other side of the upper jaw. But in cases where, for example, the restoration is a complete denture or the restoration is made up of all the anterior teeth, for example, in the upper jaw, then the new teeth in the restoration can be designed to match and adjust to the features facial features of the patient's face as seen in the 2D image, and the restoration may not be designed to be symmetrical to any tooth in the patient's mouth. Although some modalities have been described and shown in detail, the invention is not restricted to them, but can also be incorporated in other forms within the scope of the subject in question defined in the following claims. In particular, it should be understood that other modalities can be used and structural and functional modifications can be made without departing from the scope of the present invention.
[000285] In the claims referring to the device that enumerate different means, several means can be incorporated by one or by the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims or described in different modalities, does not indicate that a combination of these measures cannot be used to advantage.
[000286] It should be emphasized that the term "understands / understands" when used in this specification is taken to specify the presence of established resources, whole numbers, steps or components, but does not eliminate the presence or addition of one or more resources, whole numbers, steps, components or groups of them.
[000287] When a claim refers to any of the preceding claims, this is understood to mean any one or more of the preceding claims. The features of the method described above and subsequent can be implemented in software and executed in a data processing system or other processing means caused by the execution of executable instructions by computer. Instructions can be a program encoding medium loaded into memory, such as RAM, from a storage medium or from another computer via a computer network. Alternatively, the features described can be deployed by physically connected circuitry, instead of software or in combination with software.

权利要求:
Claims (23)
[0001]
1. Method of projecting a dental restoration onto a patient, the method characterized by the fact that it comprises: providing one or more 2D images, in which at least one 2D image comprises at least one facial feature; provide a virtual 3D model of at least part of the patient's oral cavity; arrange at least one of one or more 2D images in relation to the virtual 3D model in a virtual 3D space, such that the 2D image and the virtual 3D model are aligned when viewed from a viewing point, through which the model Virtual 3D and the 2D image are both visualized in 3D space; and model a restoration on the virtual 3D model, where the restoration is designed to fit the facial feature of at least one 2D image.
[0002]
2. Method, according to claim 1, characterized by the fact that facial features are present in an image of the patient and / or in a generic image of a person.
[0003]
3. Method, according to claim 1 or 2, characterized by the fact that the facial features comprise one or more imaginary lines of a face adapted to be detected in the 2D image, such as the middle line, the horizontal line and / or the two-line line.
[0004]
4. Method according to claim 1, 2 or 3, characterized by the fact that the 2D image and the 3D model are aligned based on one or more unprepared teeth.
[0005]
5. Method according to any of claims 1 to 4, characterized in that the method comprises providing two virtual 3D models, in which the first virtual 3D model comprises at least one prepared tooth and the second virtual 3D model does not comprise prepared teeth, and in which the first and second virtual 3D models are aligned.
[0006]
6. Method according to any one of claims 1 to 5, characterized in that the method comprises virtually cutting at least part of the teeth out of at least one 2D image, such that at least the lips remain visible in the image in 2D.
[0007]
Method according to any one of claims 1 to 6, characterized in that the method comprises cutting the part of the 2D image that is within the edge of the lips.
[0008]
A method according to any one of claims 1 to 7, wherein the edge of the lips is marked on the 2D image.
[0009]
9. Method according to any of claims 1 to 8, characterized in that the silhouette of the bite edge of at least the upper anterior teeth in one or more 2D images and in the virtual 3D model is used to perform the alignment one or more 2D images and the virtual 3D model.
[0010]
10. Method according to any one of claims 1 to 9, characterized by the fact that the method also comprises scaling one or more 2D digital images and the virtual 3D model to show at least part of the teeth in the same size .
[0011]
11. Method according to any one of claims 1 to 10, characterized by the fact that the method further comprises sectioning at least two or more of the teeth in the 3D model and / or in one or more 2D images.
[0012]
12. Method according to any of claims 1 to 11, characterized by the fact that the alignment of the 3D model and one or more 2D images for one or more perspective views is carried out by means of interpolation and / or extrapolation of other perspective views.
[0013]
13. Method according to any one of claims 1 to 12, characterized by the fact that the texture of the 2D image is mapped in the virtual 3D model and / or in the restoration.
[0014]
14. Method according to any one of claims 1 to 13, characterized by the fact that the method further comprises changing the perspective view of one or more 2D digital images and / or the virtual 3D model to obtain the same perspective view.
[0015]
15. Method according to any one of claims 1 to 14, characterized in that the method comprises determining an angle of one or more of the perspective views.
[0016]
16. Method according to any one of claims 1 to 15, characterized by the fact that the angle of the 3D model and the 2D image is configured to adapt to the perspective view of the 2D image.
[0017]
17. Method according to any of claims 1 to 16, characterized in that the method further comprises distorting the perspective view of one or more 2D images to visually align with one or more 2D images and the virtual 3D model.
[0018]
18. Method according to any one of claims 1 to 17, characterized by the fact that one or more 2D digital images is a model to support the patient's teeth model.
[0019]
19. Method according to any one of claims 1 to 18, characterized in that the one or more 2D digital images shows a facial feature in the form of at least several frontal teeth.
[0020]
20. Method according to any one of claims 1 to 19, characterized in that the one or more 2D digital images is an X-ray image of the patient's teeth.
[0021]
21. Method, according to any one of claims 1 to 20, characterized by the fact that the method also comprises the steps of: detecting anatomical points in the teeth, in which the anatomical points are present and are detectable both in one or more more 2D digital images as in the 3D virtual model, and perform virtual actions, such as scaling, aligning, projecting to a plane and changing perspective, for disposition based on these corresponding anatomical points.
[0022]
22. System for projecting a dental restoration to a patient, characterized by the fact that it comprises: means for providing one or more 2D images, in which at least one 2D image comprises at least one facial feature; means for providing a virtual 3D model of at least part of the patient's oral cavity; means for arranging at least one of one or more 2D images in relation to the virtual 3D model in a virtual 3D space, such that the 2D image and the virtual 3D model are aligned when viewed from a viewing point the virtual 3D model and the 2D image are both viewed in 3D space; and means for modeling a restoration on the virtual 3D model, where the restoration is designed to fit the facial feature of at least one 2D image.
[0023]
23. System according to claim 22, characterized by the fact that it also comprises means for sectioning virtually at least part of the teeth outside at least one 2D image, so that at least the lips remain visible in the 2D image .

类似技术:

---

公开号 | 公开日 | 专利标题

---

BR112012033392B1|2020-12-15|METHOD AND SYSTEM FOR PROJECTING A DENTAL RESTORATION FOR A PATIENT

---

ES2896679T3|2022-02-25|Software product for the planning, visualization and optimization of dental restorations

---

ES2717447T3|2019-06-21|Computer-assisted creation of a habitual tooth preparation using facial analysis

---

ES2675567T3|2018-07-11|Modeling a digital design of a dental prosthesis

---

DK2593036T3|2018-04-16|Dental Analysis - Method and System

---

JP2013531531A5|2014-08-14|

---

WO2012083960A1|2012-06-28|System and method for scanning objects being modified

---

Lam et al.2018|Mapping intraoral photographs on virtual teeth model

---

ES2877219T3|2021-11-16|2D image arrangement

---

ES2731916T3|2019-11-19|Design of a virtual preparation and a virtual gum

同族专利:

---

公开号 | 公开日

---

JP2013531531A|2013-08-08|

---

RU2012157379A|2014-08-10|

---

EP2588021B1|2021-03-10|

---

AU2011273999B2|2015-02-05|

---

KR20140015239A|2014-02-06|

---

EP3851069A1|2021-07-21|

---

AU2011273999A1|2013-01-17|

---

EP2588021A1|2013-05-08|

---

US9336336B2|2016-05-10|

---

CN103079494A|2013-05-01|

---

WO2012000511A1|2012-01-05|

---

RU2593741C2|2016-08-10|

---

CA2803028C|2019-03-12|

---

BR112012033392A2|2016-11-22|

---

CN103079494B|2016-09-14|

---

KR101799878B1|2017-11-22|

---

CA2803028A1|2012-01-05|

---

EP2588021A4|2015-10-14|

---

US20130218530A1|2013-08-22|

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

---

AUPO280996A0|1996-10-04|1996-10-31|Dentech Investments Pty Ltd|Creation and utilization of 3D teeth models|

---

JP3121301B2|1997-10-28|2000-12-25|得丸正博|Artificial tooth manufacturing system and method|

---

IL126838A|1998-11-01|2003-04-10|Cadent Ltd|Dental image processing method and system|

---

ES2147151B1|1998-11-24|2000-12-16|Busca Rey M Del Mar|DEVICE FOR THE TREATMENT OF FUEL IN THERMAL ENGINES.|

---

JP3040997B1|1999-03-29|2000-05-15|佳知 高石|Maxillary tooth size determination device|

---

US7717708B2|2001-04-13|2010-05-18|Orametrix, Inc.|Method and system for integrated orthodontic treatment planning using unified workstation|

---

US7155373B2|2002-02-22|2006-12-26|3M Innovative Properties Company|Selection of orthodontic brackets|

---

US20060127836A1|2004-12-14|2006-06-15|Huafeng Wen|Tooth movement tracking system|

---

DE102006043284A1|2006-09-14|2008-03-27|Dental Consulting Mönkmeyer S.L.|Method and system for producing a dental prosthesis|

---

GB0707454D0|2007-04-18|2007-05-23|Materialise Dental Nv|Computer-assisted creation of a custom tooth set-up using facial analysis|

---

EP2282697B1|2008-06-02|2016-12-14|DENTSPLY International Inc.|Methods for designing a customized dental prosthesis using digital images of a patient|

---

US8718982B2|2008-09-18|2014-05-06|3Shape A/S|Tools for customized design of dental restorations|US10092373B2|2011-05-15|2018-10-09|Orametrix, Inc.|Orthodontic treatment planning using lip tracer|

---

US8092215B2|2008-05-23|2012-01-10|Align Technology, Inc.|Smile designer|

---

KR101844549B1|2010-07-12|2018-04-02|쓰리세이프 에이/에스|3D modeling of an object using textural features|

---

ES2665997T3|2010-07-12|2018-04-30|Centre De Recherche Medico Dentaire Am Inc.|Method and system of dental analysis|

---

US9403238B2|2011-09-21|2016-08-02|Align Technology, Inc.|Laser cutting|

---

BE1020425A5|2011-11-08|2013-10-01|Guy Adriaens Dental Labo Bvba|METHOD FOR MANUFACTURING A DENTURE ELEMENT OR TOOL FOR ADJUSTING THE DENTURE, FACEBOW AND ARTICULATOR.|

---

US9872745B2|2012-02-14|2018-01-23|3Shape A/S|Modeling a digital design of a denture|

---

US9220580B2|2012-03-01|2015-12-29|Align Technology, Inc.|Determining a dental treatment difficulty|

---

US9414897B2|2012-05-22|2016-08-16|Align Technology, Inc.|Adjustment of tooth position in a virtual dental model|

---

WO2014135695A1|2013-03-08|2014-09-12|3Shape A/S|Visualising a 3d dental restoration on a 2d image|

---

US10405945B2|2013-03-14|2019-09-10|National Dentex, Llc|Bone foundation guide and method of use|

---

US10398530B2|2013-03-14|2019-09-03|National Dentex, Llc|Bone foundation guide system and method|

---

US10639129B2|2013-03-14|2020-05-05|National Dentex, Llc|Bone foundation guide system and method|

---

US10278789B2|2013-03-14|2019-05-07|National Dentex, Llc|Bone foundation guide system and method|

---

US10307226B2|2013-03-14|2019-06-04|National Dentex, Llc|Bone foundation guide and method of use|

---

US10098713B2|2013-03-14|2018-10-16|Ormco Corporation|Scanning sequence for an intra-oral imaging system|

---

US10192320B2|2013-03-15|2019-01-29|Demetrios S. Meletiou, JR.|Dental method of smile design|

---

RU2532358C1|2013-04-12|2014-11-10|Наталия Юрьевна Чернышова|Method for measuring mandibular inclination and device for cast model transfer into articulator space|

---

WO2015063032A1|2013-10-28|2015-05-07|3Shape A/S|Method for applying design guides|

---

WO2015089676A1|2013-12-19|2015-06-25|Trispera Dental Inc.|System and method for recording a bite of an edentulous individual|

---

WO2015118120A1|2014-02-07|2015-08-13|3Shape A/S|Detecting tooth shade|

---

US10166091B2|2014-02-21|2019-01-01|Trispera Dental Inc.|Augmented reality dental design method and system|

---

DE102014207667A1|2014-04-23|2015-10-29|Sirona Dental Systems Gmbh|Method for carrying out an optical three-dimensional recording|

---

EP3136943A4|2014-05-01|2017-12-27|EndoChoice, Inc.|System and method of scanning a body cavity using a multiple viewing elements endoscope|

---

US10123856B2|2014-05-08|2018-11-13|Cagenix, Inc.|Dental framework and prosthesis|

---

KR20160004863A|2014-07-04|2016-01-13|주식회사 인스바이오|The virtual set-up method for the orthodontics procedure|

---

US10772506B2|2014-07-07|2020-09-15|Align Technology, Inc.|Apparatus for dental confocal imaging|

---

US9675430B2|2014-08-15|2017-06-13|Align Technology, Inc.|Confocal imaging apparatus with curved focal surface|

---

US9610141B2|2014-09-19|2017-04-04|Align Technology, Inc.|Arch expanding appliance|

---

US10449016B2|2014-09-19|2019-10-22|Align Technology, Inc.|Arch adjustment appliance|

---

EP3197389B1|2014-09-24|2019-08-21|3Shape A/S|Creating a digital restoration design|

---

WO2016055890A1|2014-10-06|2016-04-14|Amato Aldo|Method for determining and drawing the ideal individual shape of the six upper front teeth|

---

US9744001B2|2014-11-13|2017-08-29|Align Technology, Inc.|Dental appliance with cavity for an unerupted or erupting tooth|

---

US10258439B1|2014-11-20|2019-04-16|Ormco Corporation|Method of manufacturing orthodontic devices|

---

WO2016083519A1|2014-11-27|2016-06-02|3Shape A/S|Method of digitally designing a modified dental setup|

---

KR101590140B1|2014-12-11|2016-01-29|주식회사 디오코|Three-dimensional dental image displaying method and three-dimensional dental image displaying method apparatus for observing occlusal tooth on multi direction, and a computer-readable storage medium storing computer program for three-dimensional dental image displaying method|

---

US10504386B2|2015-01-27|2019-12-10|Align Technology, Inc.|Training method and system for oral-cavity-imaging-and-modeling equipment|

---

US10074178B2|2015-01-30|2018-09-11|Dental Imaging Technologies Corporation|Intra-oral image acquisition alignment|

---

US9451873B1|2015-03-06|2016-09-27|Align Technology, Inc.|Automatic selection and locking of intraoral images|

---

US10049467B2|2015-03-18|2018-08-14|Vatech Co., Ltd.|Apparatus and method for reconstructing medical image|

---

US20180071062A1|2015-03-20|2018-03-15|3M Innovative Properties Company|A method of making a dental restoration|

---

CN104751463B|2015-03-31|2017-10-13|同济大学|A kind of threedimensional model optimal viewing angle choosing method based on sketch outline feature|

---

US10248883B2|2015-08-20|2019-04-02|Align Technology, Inc.|Photograph-based assessment of dental treatments and procedures|

---

DE102015222782A1|2015-11-18|2017-05-18|Sirona Dental Systems Gmbh|Method for visualizing a dental situation|

---

US11103330B2|2015-12-09|2021-08-31|Align Technology, Inc.|Dental attachment placement structure|

---

EP3203440A1|2016-02-08|2017-08-09|Nokia Technologies Oy|A method, apparatus and computer program for obtaining images|

---

JP2017187882A|2016-04-04|2017-10-12|セイコーエプソン株式会社|Computer program used for image processing|

---

CN105816252A|2016-04-25|2016-08-03|四川大学|Digital tooth arrangement method|

---

WO2017218951A1|2016-06-17|2017-12-21|Align Technology, Inc.|Orthodontic appliance performance monitor|

---

EP3471599A4|2016-06-17|2020-01-08|Align Technology, Inc.|Intraoral appliances with sensing|

---

CN109844819A|2016-06-27|2019-06-04|罗伯特·博世有限公司|System and method for dynamic barriers disposition|

---

EP3578131B1|2016-07-27|2020-12-09|Align Technology, Inc.|Intraoral scanner with dental diagnostics capabilities|

---

US10507087B2|2016-07-27|2019-12-17|Align Technology, Inc.|Methods and apparatuses for forming a three-dimensional volumetric model of a subject's teeth|

---

CN107684465B|2016-08-03|2020-06-16|佛山市诺威科技有限公司|Digital generation method for denture bridge connector|

---

KR101687821B1|2016-09-22|2016-12-20|장원석|Method for dental surgery using augmented reality|

---

IT201600097960A1|2016-09-29|2018-03-29|Nivol S R L|PROCESS OF MANUFACTURE OF ORTHODONTIC EQUIPMENT FOR INCREMENTAL DENTAL REPOSITIONING|

---

CN113648088A|2016-11-04|2021-11-16|阿莱恩技术有限公司|Method and apparatus for dental images|

---

US11026831B2|2016-12-02|2021-06-08|Align Technology, Inc.|Dental appliance features for speech enhancement|

---

CN110062609B|2016-12-02|2021-07-06|阿莱恩技术有限公司|Method and apparatus for customizing a rapid palate expander using a digital model|

---

US10548700B2|2016-12-16|2020-02-04|Align Technology, Inc.|Dental appliance etch template|

---

US10456043B2|2017-01-12|2019-10-29|Align Technology, Inc.|Compact confocal dental scanning apparatus|

---

US10779718B2|2017-02-13|2020-09-22|Align Technology, Inc.|Cheek retractor and mobile device holder|

---

US10758322B2|2017-03-20|2020-09-01|Align Technology, Inc.|Virtually representing an orthodontic treatment outcome using automated detection of facial and dental reference objects|

---

US10613515B2|2017-03-31|2020-04-07|Align Technology, Inc.|Orthodontic appliances including at least partially un-erupted teeth and method of forming them|

---

CN107252356B|2017-05-15|2020-07-24|西安知北信息技术有限公司|Digital oral aesthetic restoration method|

---

US10231806B2|2017-05-29|2019-03-19|Jang-Ching Chou|Aligning apparatus used in fabricating dental prostheses|

---

US11045283B2|2017-06-09|2021-06-29|Align Technology, Inc.|Palatal expander with skeletal anchorage devices|

---

US10639134B2|2017-06-26|2020-05-05|Align Technology, Inc.|Biosensor performance indicator for intraoral appliances|

---

IT201700078609A1|2017-07-13|2019-01-13|Luca Levrini|INTEGRATIVE METHOD FOR COMBINED VISUALIZATION OF OCCLUSAL AND AESTHETIC FACE RESULTS AFTER ORTHODONTIC TREATMENT|

---

US10885521B2|2017-07-17|2021-01-05|Align Technology, Inc.|Method and apparatuses for interactive ordering of dental aligners|

---

EP3658067A1|2017-07-27|2020-06-03|Align Technology, Inc.|System and methods for processing an orthodontic aligner by means of an optical coherence tomography|

---

US11116605B2|2017-08-15|2021-09-14|Align Technology, Inc.|Buccal corridor assessment and computation|

---

WO2019036677A1|2017-08-17|2019-02-21|Align Technology, Inc.|Dental appliance compliance monitoring|

---

KR101953622B1|2017-08-31|2019-05-23|주식회사 디오|Method for adjusting intraorla images of different types|

---

KR101956109B1|2017-08-31|2019-06-19|주식회사 디오|Method for adjusting intraorla images of different types|

---

US10813720B2|2017-10-05|2020-10-27|Align Technology, Inc.|Interproximal reduction templates|

---

CN109717966B|2017-10-27|2021-04-30|华硕电脑股份有限公司|Image simulation method and image simulation device for tooth shaping|

---

US11096763B2|2017-11-01|2021-08-24|Align Technology, Inc.|Automatic treatment planning|

---

US11270523B2|2017-11-29|2022-03-08|Sdc U.S. Smilepay Spv|Systems and methods for constructing a three-dimensional model from two-dimensional images|

---

CN111417357A|2017-11-30|2020-07-14|阿莱恩技术有限公司|Sensor for monitoring oral appliance|

---

KR102040099B1|2017-12-04|2019-12-05|울산대학교 산학협력단|Apparatus and method for determining area of detal implant placement|

---

US10552665B2|2017-12-12|2020-02-04|Seiko Epson Corporation|Methods and systems for training an object detection algorithm using synthetic images|

---

US10980613B2|2017-12-29|2021-04-20|Align Technology, Inc.|Augmented reality enhancements for dental practitioners|

---

CN108305689A|2018-01-18|2018-07-20|成都贝施美医疗科技股份有限公司|Dental Erosion effect generation method and device|

---

US10410089B2|2018-01-19|2019-09-10|Seiko Epson Corporation|Training assistance using synthetic images|

---

US11013581B2|2018-01-26|2021-05-25|Align Technology, Inc.|Diagnostic intraoral methods and apparatuses|

---

US11083552B2|2018-02-20|2021-08-10|Ivoclar Vivadent Ag|Rendering of dental models|

---

US10779917B2|2018-02-20|2020-09-22|Ivoclar Vivadent Ag|Computer implemented method for modifying a digital three-dimensional model of a dentition|

---

DK3530232T3|2018-02-21|2021-08-02|Ivoclar Vivadent Ag|PROCEDURE FOR ADJUSTING A THREE-DIMENSIONAL MODEL OF A DENTAL OF A PATIENT TO AN IMAGE OF THE FACE OF THE PATIENT RECORDED BY A CAMERA|

---

WO2019178190A1|2018-03-13|2019-09-19|Ormco Corporation|Orthodontic appliances, digital tools, and methods for dental treatment planning|

---

US10769437B2|2018-04-10|2020-09-08|Seiko Epson Corporation|Adaptive sampling of training views|

---

US10878285B2|2018-04-12|2020-12-29|Seiko Epson Corporation|Methods and systems for shape based training for an object detection algorithm|

---

US11020206B2|2018-05-22|2021-06-01|Align Technology, Inc.|Tooth segmentation based on anatomical edge information|

---

US20210264600A1|2018-06-21|2021-08-26|3Shape A/S|Method, device and system for correlating at least one additional 2d-image to a 3d-representation of at least a part of tooth|

---

USD870765S1|2018-08-14|2019-12-24|Ralph Georg|Computing device display screen with graphical user interface for generating a three-dimensional orofacial workflow|

---

US10634918B2|2018-09-06|2020-04-28|Seiko Epson Corporation|Internal edge verification|

---

EP3629336A1|2018-09-28|2020-04-01|Ivoclar Vivadent AG|Dental design transfer|

---

US10810738B1|2018-12-07|2020-10-20|Bellus 3D, Inc.|Marker-less alignment of digital 3D face and jaw models|

---

US10839481B1|2018-12-07|2020-11-17|Bellus 3D, Inc.|Automatic marker-less alignment of digital 3D face and jaw models|

---

KR102129526B1|2019-03-12|2020-07-02|주식회사 키스톤|3D printing connector production system for transferring occlusion information formed by 3D data to a real articulator and manufacture methods the same|

---

WO2020209496A1|2019-04-11|2020-10-15|주식회사 디오|Dental object detection method, and image matching method and device using dental object|

---

KR102224064B1|2019-04-11|2021-03-08|주식회사 디오|Apparatus For Separating Gum Area From Oral Scan Image|

---

US10849723B1|2019-05-07|2020-12-01|Sdc U.S. Smilepay Spv|Scanning device|

---

KR102232043B1|2019-05-09|2021-03-25|주식회사 디오|Method and Apparatus for Creating Model for Separating of Teeth and Alveolar Bone in Image Data|

---

US11000349B2|2019-06-05|2021-05-11|Dentsply Sirona Inc.|Method, system and computer readable storage media for determining articulation parameters|

---

KR20210056141A|2019-11-08|2021-05-18|김태원|Apparatus for superimposing teeth image onto face image|

---

US20210153986A1|2019-11-25|2021-05-27|Dentsply Sirona Inc.|Method, system and computer readable storage media for creating three-dimensional dental restorations from two dimensional sketches|

---

US10916053B1|2019-11-26|2021-02-09|Sdc U.S. Smilepay Spv|Systems and methods for constructing a three-dimensional model from two-dimensional images|

---

RU2745078C1|2020-02-17|2021-03-19|федеральное государственное бюджетное образовательное учреждение высшего образования "Волгоградский государственный медицинский университет" Министерства здравоохранения Российской Федерации|Method for determining the area of anatomical regions and sections with complex relief|

---

CN111973309A|2020-07-24|2020-11-24|上海交通大学医学院附属第九人民医院|Method for manufacturing blending guide plate|

---

RU2758206C1|2020-11-28|2021-10-26|Федеральное государственное бюджетное образовательное учреждение высшего образования "Рязанский государственный медицинский университет имени академика И.П. Павлова" Министерства здравоохранения Российской Федерации|Method for morphometric examination of the upper and lower jaws|

---

CN112905097A|2021-03-23|2021-06-04|贵州航天云网科技有限公司|Industrial product display system and method based on 3D technology|

法律状态:
2018-12-26| B06F| Objections, documents and/or translations needed after an examination request according [chapter 6.6 patent gazette]|

---

2019-08-20| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]|

---

2020-10-06| B09A| Decision: intention to grant [chapter 9.1 patent gazette]|

---

2020-10-13| B09W| Correction of the decision to grant [chapter 9.1.4 patent gazette]|Free format text: RETIFICACAO DO DEFERIMENTO NOTIFICADO NA RPI 2596 DE 06/10/2020. |

---

2020-12-15| B16A| Patent or certificate of addition of invention granted [chapter 16.1 patent gazette]|Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 29/06/2011, OBSERVADAS AS CONDICOES LEGAIS. |

优先权:

---

申请号 | 申请日 | 专利标题

---

US35945410P| true| 2010-06-29|2010-06-29|

---

US61/359,454|2010-06-29|

---

DKPA201000568|2010-06-29|

---

DKPA201000568|2010-06-29|

---

US201161454200P| true| 2011-03-18|2011-03-18|

---

US61/454,200|2011-03-18|

---

DKPA201100191|2011-03-18|

---

PCT/DK2011/050246|WO2012000511A1|2010-06-29|2011-06-29|2d image arrangement|

---